United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
I nihil Stall-, Patent ami Trademark Office 

Address: COMMISSIONER FOR PATENTS 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO. CONFIRMATION NO. 



10/593.339 



09/19/2000 



44696 7590 01/07/2011 

DR. MARK M. FRIEDMAN 

C/O BILL POLKINGHORN - DISCOVERY DISPATCH 

9003 FLORIN WAY 

UPPER MARLBORO, MD 20772 



HUSSAIN, FARRUKH 



PAPER NUMBER 



NOTIFICATION DATE | DELIVERY MODE 
01/07/2011 ELECTRONIC 



Please find below and/or attached an Office communication concerning this application or proceeding. 

The time period for reply, if any, is set in the attached communication. 

Notice of the Office communication was sent electronically on above-indicated "Notification Date" to the 
following e-mail address(es): 

mark_f@friedpat.com 
nomi_m@friedpat.com 
li-icdpal.usplo@ginaiL.com 



PTOL-90A (Rev. 04/07) 



Office Action Summary 



Application No. 



FARRUKH HUSSAIN 



- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time maybe available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )IEI Responsive to communication(s) filed on 28 October 2010 . 
2a)M This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^3 Claim(s) 42-77 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) S Claim(s) 42-77 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. §119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)DAII b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

20 Certified copies of the priority documents have been received in Application No. . 

3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) ^ Notice of References Cited (PTO-892) 

2) O Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) □ Information Disclosure Statement(s) (PTO/SB/08) 

Paper No(s)/Mail Date . 

PTOL-326 (Rev. 08-06) Office 



4) Interview Summary (PTO-413) 
Paper No(s)/Mail Date. . 

5) O Notice of Informal Patent Application 

6) □ Other: . 



Summary Part of Paper No./Mail Date 201 10101 



Application/Control Number: 10/593,339 Page 2 

Art Unit: 2444 

DETAILED ACTION 

1 . This action is in regards to the response received on 1 0/28/201 0. 
Claims 42, 55, 57, 58 and 77 have been amended. Claims 42-77 are pending. 

Response to Arguments 

2. Applicant's arguments filed 10/28/2010 with respect to claims 42-77 
have been considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 1 02 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

3. Claims 42-59 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Gelvin et al. (Gelvin) (US 6,859,831 B1), in view of 
Cobbley et al. (Cobbley) (US 5,818,510). 

4. With respect to the claim 42, Gelvin reference teaches A method for 
retrieving information from a network-based information-provider comprising: 

a) providing a network-enabled, data-capture device configured to retrieve 
information from a network having at least one information provider operative to 
provide search results to queries defined at least in part by electronic 
representations of real-world entities (See column 1, lines 35-42, the invention 
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relates to providing distributed network and Internet access to sensors (captured- 
data), controls, and processors that are embedded in equipment, facilities, and 
the environment and See column 36, lines 26-42, Embodiments of the DQLs for 
sensor programming and information retrieval include small footprint standard 
query language (SQL) database systems and See column 17, lines 15-17, o. 
BOOL Node -Search: Initiates search of network for participating nodes that are 
in range of and have been acquired by the local gateway.) 

c) retrieving information from said network- based, information- 
provider based on the query (See column 36, lines 1-10, Further, a prior search 
of the database may limit the number of nodes that are specifically queried to 
gather (retrieving) information that is missing, but needed to answer the 
request..); and 

d) presenting the information by way of a user-output interface (See 
column 3, lines 49-55, The typical network includes a number of sensor nodes 
202, a master 204, and a user interface 206.). 

Gelvin fails to explicitly teach b) formulating a query by transforming data 
obtained from at least one real-world entity into an electronic representation of 
the real-world entity by way of said data capture device; 

However, Cobbley teaches formulating a query bv transforming data 
obtained from at least one real-world entity into an electronic representation of 
the real-world entity bv way of said data capture device (See column 6, lines 12- 
32, communications link (real-world entity) to examine (query; the broadcast 
information and obtain the indexing information. Thus, for certain video and 
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speech recognition processes, index data capture device 1 12 converts 
(transform) the broadcast information to digital form (electronic representation,) 
prior to performing the recognition J; 

Therefore, it would have been obvious to a person of ordinary skill in the 
art at the time the invention was made to have combined the teachings of 
Cobbley to utilize the transforming data obtained from at least one real-world 
entity feature within the providing a network-enabled, data-capture device 
configured to retrieve information taught by Gelvin. The motivation for this would 
have been to provide a system which allows an individual to quickly and easily 
access the stored information (see Cobbley, column 2, lines 1-4). 

5. With respect to the claim 43, Gelvin further teaches wherein said data- 
capture device includes an image capture device (See column 5, lines 65-67 and 
column 6, lines 1-5, a seismic sensor and energy detector circuit is used to 
trigger a digital camera under the control of a computer). 

6. With respect to the claim 44, Gelvin further teaches wherein said data- 
capture device includes a microphone (See column 18, lines 55-59, and compact 
electet microphones for acoustics). 

7. With respect to the claim 45, Gelvin further teaches wherein said data- 
capture device includes a radio receiver (See column 2, lines 35-40, sensors with 
manual controls on sensitivity and radio channel selection (receiver), and one- 
way communication of raw data to a network master). 

8. With respect to the claim 46, Gelvin further teaches wherein said data- 
capture device includes a data-capture device selected from the group consisting 
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of scent detector, taste sensor, geophone, motion sensor, acceleration meter, 
wind meter, thermometer, humidly sensor, texture sensor, location sensor, and 
global positioning system receiver (See column 5, lines 24-30, for example 
Global Position System (GPS) or hand registration of position). 

9. With respect to the claim 47, Gelvin further teaches wherein said data- 
capture device is integrated into a cellular phone (See column 32, lines 20-25, 
wireless cellular telephony, and satellite telephony.). 

1 0. With respect to the claim 48, Gelvin further teaches wherein said 
data-capture device is integrated into a device selected from the group consisting 
of a wireless phone, netphone, personal digital assistant, portable computer, 
pager, and personal computer (See column 32, lines 20-25, wireless cellular 
telephony, and satellite telephony.). 

1 1 . With respect to the claim 49, Gelvin further teaches wherein said 
network-based information- provider is implemented as a network-based 
dedicated server configured to perform data-processing on data of the electronic 
representation of real-world entities by said data-capture device (See column 32, 
lines 35-40, and signal processing objects and data to an entire node 
population.). 

1 2. With respect to the claim 50, Gelvin further teaches said at least one 
network-based information-provider is selected from the group consisting of a 
World-Wide- Web site, intranet site, extranet site, database, knowledge-base, 
search engine, dedicated server and service center (See column 6, lines 59-67, 
network resources such as database are available). 
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1 3. With respect to the claim 51 , Gelvin further teaches wherein said 
query being at least one electronic representation of a real-world entity includes 
an image (See column 5, lines 50-60, The images processed by the host 
computer). 

1 4. With respect to the claim 52, Gelvin further teaches wherein said 
query being at least one electronic representation of a real-world entity includes a 
sound recording (See column 20, lines 15-20, targets are used to provide the 
sounding impulses for node location). 

1 5. With respect to the claim 53, Gelvin further teaches wherein said 
query being at least one electronic representation of a real-world entity includes 
an. information segment encoded in electromagnetic radiation [See figure 40, IR 
Sensor, radiation). 

1 6. With respect to the claim 54, Gelvin further teaches wherein said 
query being at least one electronic representation of a real-word entity selected 
from the group consisting of odor, taste, texture, motion, and vibration (See 
column 18, lines 40-50, infrared motion devices.).. 

1 7. With respect to the claim 55, Gelvin further teaches wherein said 
formulating a query includes fusing data of a plurality of electronic 
representations of real-world entities captured by said data-capture device (See 
column 2, lines 45-50, so that fusion of data across multiple types of sensors is 
possible in one node.). 

1 8. With respect to the claim 56, Gelvin further teaches wherein said 
formulating a query includes fusing data inputted by a user with said at least one 
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electronic representation of real-world entities captured by said data-capture 
device (See column 2, lines 45-50, so that fusion of data across multiple types of 
sensors is possible in one node.). 

1 9. With respect to the claim 57, Gelvin further teaches further 
comprising 

presenting information retrieved from said information-provider service by 
way of a user output-device (See column 19, lines 15-25Touch Screen, 
Microphone, Audio Output). 

20. With respect to the claim 58, Gelvin further teaches wherein said 
user output device is selected from the group consisting of a visual output device, 
audio output device, textural output device, motion generator, electromagnetic 
transmitter, vibrator and scent generator (See column 19, lines 15-25 Touch 
Screen, Microphone, Audio Output). 

21 . With respect to the claim 59, Gelvin further teaches further 
comprising alerting a relevant party in response to the information retrieved from 
said network-based information-provider according to instructions inputted by a 
user by way of said user-input interface (See column 19, lines 15-25 Touch 
Screen (input interface), Microphone, Audio Output.). 

Claim Rejections - 35 USC §102 

The following is a quotation of the appropriate paragraphs of 35 
U.S.C. 102 that form the basis for the rejections under this section made in this 
Office action: 
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A person shall be entitled to a patent unless - 

(e) the invention was described in (1 ) an application for patent, published under section 
122(b), by another filed in the United States before the invention by the applicant for patent or 
(2) a patent granted on an application for patent by another filed in the United States before 
the invention by the applicant for patent, except that an international application filed under 
the treaty defined in section 351 (a) shall have the effects for purposes of this subsection of an 
application filed in the United States only if the international application designated the United 
States and was published under Article 21 (2) of such treaty in the English language. 

22. Claims 60-77 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Gelvin et al. (Gelvin) (US 6,859,831 B1). 

23. With respect to the claim 60, Gelvin further teaches A portable, 
network-enabled information retrieval device comprising: 

a) a portable, data-capture device for generating electronic 
representations of real-world entities (See column 5, lines 65-67 and column 6, 
lines 1-5, a seismic sensor and energy detector circuit is used to trigger a digital 
camera (portable) under the control of a computer); 

b) a network interface (See column 3, lines 49-55, The typical network 
includes a number of sensor nodes 202, a master 204, and a user interface 
206.); and 

c) a processor, said processor being configured to generate network 
queries for retrieving information from a network containing information-provider, 
said query being at least one electronic representation of a real-world entity 
captured by said data-capture device (See column 5, lines 65-67 and column 6, 
lines 1-5, a seismic sensor and energy detector circuit is used to trigger a digital 
camera under the control of a computer (processor)). 

24. With respect to the claim 61 , Gelvin further teaches wherein said 
data-capture device includes an image capture device so as to be an image- 
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based search engine. {See column 5, lines 65-67 and column 6, lines 1-5, a 
seismic sensor and energy detector circuit is used to trigger a digital camera 
under the control of a computer (search engine)). 

25. With respect to the claim 62, Gelvin further teaches wherein said 
data-capture device includes a microphone (See column 18, lines 55-59, and 
compact electet microphones for acoustics). 

26. With respect to the claim 63, Gelvin further teaches wherein said 
data-capture device includes a radio receiver (See column 2, lines 35-40, 
sensors with manual controls on sensitivity and radio channel selection 
(receiver), and one-way communication of raw data to a network master). 

27. With respect to the claim 64, Gelvin further teaches wherein said 
data-capture device includes a data-capture device selected from the group 
consisting of scent detector, taste sensor, geophone, motion sensor, acceleration 
meter, wind meter, thermometer, humidly sensor, texture sensor, location sensor, 
and global positioning system receiver (See column 5, lines 24-30, for example 
Global Position System (GPS) or hand registration of position). 

28. With respect to the claim 65, Gelvin further teaches wherein said 
data-capture device is integrated into a cellular phone (See column 32, lines 20- 
25, wireless cellular telephony, and satellite telephony.). 

29. With respect to the claim 66, Gelvin further teaches wherein said 
data-capture device is integrated into a device selected from the group consisting 
of a wireless phone, netphone, personal digital assistant, portable computer, 
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pager, and personal computer (See column 32, lines 20-25, wireless cellular 
telephony, and satellite telephony.). 

30. With respect to the claim 67, Gelvin further teaches wherein said 
query being at least one electronic representation of a real-world entity includes 
an image {See column 5, lines 50-60, The images processed by the host 
computer). 

31 . With respect to the claim 68, Gelvin further teaches wherein said 
query being at least one electronic representation of a real-world entity includes a 
sound recording (See column 20, lines 15-20, targets are used to provide the 
sounding impulses for node location). 

32. With respect to the claim 69, Gelvin further teaches wherein said 
query being at least one electronic representation of a real-world entity includes 
an. information segment encoded in electromagnetic radiation (See figure 40, IR 
Sensor, radiation). 

33. With respect to the claim 70, Gelvin further teaches wherein said 
query being at least one electronic representation of a real-word entity selected 
from the group consisting of odor, taste, texture, motion, and vibration (See 
column 18, lines 40-50, infrared motion devices.).. 

34. With respect to the claim 71 , Gelvin further teaches wherein said 
formulating a query includes fusing data of a plurality of electronic 
representations of real-world entities captured by said data-capture device (See 
column 2, lines 45-50, so that fusion of data across multiple types of sensors is 
possible in one node.). 
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35. With respect to the claim 72, Gelvin further teaches wherein said 
formulating a query includes fusing data inputted by a user with said at least one 
electronic representation of real-world entities captured by said data-capture 
device {See column 2, lines 45-50, so that fusion of data across multiple types of 
sensors is possible in one node.). 

36. With respect to the claim 73, Gelvin further teaches wherein said 
network-based information- provider is implemented as a network-based 
dedicated server configured to perform data-processing on data of the electronic 
representation of real-world entities by said data-capture device (See column 32, 
lines 35-40, and signal processing objects and data to an entire node 
population.). 

37. With respect to the claim 74, Gelvin further teaches said at least one 
network-based information-provider is selected from the group consisting of a 
World-Wide- Web site, intranet site, extranet site, database, knowledge-base, 
search engine, dedicated server and service center {See column 6, lines 59-67, 
network resources such as database are available). 

38. With respect to the claim 75, Gelvin further teaches further 
comprising 

presenting information retrieved from said information-provider service by 
way of a user output-device {See column 19, lines 15-25Touch Screen, 
Microphone, Audio Output.). 

39. With respect to the claim 76, Gelvin further teaches wherein said 
user output device is selected from the group consisting of a visual output device, 
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audio output device, textural output device, motion generator, electromagnetic 
transmitter, vibrator and scent generator (See column 19, lines 15-25 Touch 
Screen, Microphone, Audio Output). 

40. With respect to the claim 77, Gelvin further teaches further 
comprising alerting a relevant party in response to the information retrieved from 
said network-based information-provider according to instructions inputted by a 
user by way of said user-input interface (See column 19, lines 15-25 Touch 
Screen (input interface), Microphone, Audio Output- 



Conclusion 

41 . Applicant's amendment necessitated the new ground(s) of rejection 
presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. 
See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as 
set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1 .136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 
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42. Any inquiry concerning this communication or earlier communications 
from the examiner should be directed to FARRUKH HUSSAIN whose telephone 
number is (571)270-5652. The examiner can normally be reached on Monday- 
Thursday, Alt. Friday, 7:30 A.M-5:00 P.M. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, William Vaughn can be reached on 571-272-3922. The 
fax phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 

43. Information regarding the status of an application may be obtained 
from the Patent Application Information Retrieval (PAIR) system. Status 
information for published applications may be obtained from either Private PAIR 
or Public PAIR. Status information for unpublished applications is available 
through Private PAIR only. For more information about the PAIR system, see 
http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 
(toll-free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 



/F. H./ 

Examiner, Art Unit 2444 
01/01/2011 



/WILLIAM C VAUGHN JR/ 
Supervisory Patent Examiner, Art 
Unit 



